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Abstract. Multiobjective discrete programming is a well-known family of optimization problems with a large spectrum 
of applications. The linear case has been tackled by many authors during the last years. However, the polynomial case 
has not been deeply studied due to its theoretical and computational difficulties. This paper presents an algebraic 
approach for solving these problems. We propose a methodology based on transforming the polynomial optimization 
problem in the problem of solving one or more systems of polynomial equations and we use certain Grobner bases to 
. . . solve these systems. Different transformations give different methodologies that are analyzed and compared from a 

theoretical point of view and by some computational experiments via the algorithms that they induce. 
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[jLh ! 1- Introduction 

OO A multiobjective polynomial program consists of a finite set of polynomial objective functions and a finite set of 
polynomial constraints (in inequality or equation form), and solving that problem means obtaining the set of minimal 
, elements in the feasible region defined by the constraints with respect to the partial order induced by the objective 
functions. 

Polynomial programs have a wide spectrum of applications. Examples of them are capital budgeting [17], capacity 
• planning , optimization problems in graph theory [3j , portfolio selection models with discrete features [21 HI] or 
chemical engineering among many others. The reader is referred to '18] for further applications. 
^ ■ Polynomial programming generalizes linear and quadratic programming and can serve as a tool to model engineering 
applications that are expressed by polynomial equations. Even those problems with transcendental terms such as sin, 
log, and radicals can be reformulated by means of Taylor series as a polynomial program. A survey of the publications 
on general nonlinear integer programming can be found in [9]. 
' We study here multiobjective polynomial integer programs (MOPIP). Thus, we assume that the feasible vectors 
have integer components and that there are more than one objective function to be optimized. This change makes 
single-objective and multiobjective problems to be treated in a totally different manner, since the concept of solution 
, is not the same. 

PsJ In this paper, we introduce a new methodology for solving general MOPIP based on the construction of reduced 
Grobner bases of certain ideals related to the problem and on solving triangular systems of polynomial equations given 
by those bases. Grobner bases were introduced by Bruno Buchberger in 1965 in his PhD Thesis He named it 
Grobner basis paying tribute to his advisor Wolfgang Grobner. This theory emerged as a generalization, from the one 
variable case to the multivariate polynomial case, of the Euclidean algorithm, Gaussian elimination and the Sylvester 
resultant. One of the outcomes of Grobner Bases Theory was its application to linear integer programming [8lfT4l[22]. 
; ^ ' Later, Blanco and Puerto 5 introduces a new notion of partial Grobner basis for toric ideals in order to solve 
multiobjective linear integer programs. A different approach for solving linear integer programs was developed by 
Bertsimas et al. [1] based on the application of Grobner bases for solving system of polynomial equations. This 
alternative use of Grobner bases is also used in the paper by Hagglof et al. [13] for solving continuous polynomial 
optimization problems. Further details about Grobner bases can be found in [10|, lllj. 

We describe different approaches for solving MOPIP using Grobner bases which are based on reducing the problem 
to several optimality conditions: the necessary Karush-Kuhn- Tucker, the Fritz-John and the multiobjective Fritz- John 
optimality conditions. 

The paper is structured as follows. In the next section we give some preliminaries in multiobjective polynomial 
integer optimization. We present in Section [3] our first algorithm for solving MOPIP using only the triangularization 
property of lexicographic Grobner bases. Section [4] is devoted to two different algorithms for solving MOPIP using a 
Chebyshev like scalarization and the Karush-Kuhn- Tucker or the Fritz- John optimality conditions. The last algorithm, 
based on the multiobjective Fritz- John optimality condition, is described in Section[Sl Finally, in Scction[Sl we compare 
the algorithms with the results of some computational experiments and its analysis. 
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The goal of this paper is to the solve multiobjective polynomial integer programs (MOPIP): 
(MOP/Pf,g,h) 



min {fi{x),...,fk{x)) 

S.t. 9j{x) fi: .7 = 1, . . . , TO 

hr{x) — r — 1, . . . , s 



with /i, . . . , /fc, (7i, . . . , (7m, hi, . . . ,hs polynomials in R[a;i, . . . , Xn] and the constraints defining a bounded feasible 
region. Therefore, from now on we deal with MOPIPf^gh and we denote f = g — (ffi,---,<?m) and 

h = {hi, . . . , hr). If the problem had no equality (resp. inequality) constraints, we would denote it by MOPIPf_g 
(resp. MOPIPf,h), avoiding the nonexistent term. 



However, MOPIPf, g^h can be transformed to an equivalent multiobjective polynomial binary problem. Since the 
feasible region {a: 6 R" : gj{x) < 0, hr{x) = 0, j = 1, . . . , m, r = 1, . . . , s} is assumed to be bounded, it can be always 

n 

embedded in a hypercube J^[0,Ui]". Then, every component in x, Xi, has an additional, but redundant, constraint 



i=l 



Xi < Ui. We write Xi in binary form, introducing new binary variables Zij with values in {0, 1}, Xi — ^^^q"'^ 2^ 



substituting every Xi in MOPIPf_g^h we obtain an equivalent — 1 problem. 

Then, from now on, without loss of generality, we restrict ourselves to multiobjective polynomial binary programs 
(MOPBP) in the form: 

min {fi{x),...,fk{x)) 

d^) =S ■^:l;;:;;r 

X e {0, 1}" 

If the problem had no equality (resp. inequality) constraints, we would denote the problem by MOPBPf g (resp. 
MOPBPf h), avoiding the nonexistent term. 

The number of solutions of the above problem is finite, since the decision space is finite. Thus, the number of 
feasible solutions is, at most |{0, l}"! = 2". 

It is clear that MOPBPf g h is not a standard optimization problem since the objective function is a fc-coordinate 
vector, thus inducing a partial order among its feasible solutions. Hence, solving the above problem requires an 
alternative concept of solution, namely the set of nondominated (or Pareto-optimal) points. 

A feasible vector x € M" is said to be a nondominated (or Pareto optimal) solution of MOPIPf^g if there is no 
other feasible vector y such that 

/,(2/) </,(2?) Vj = l,...,k 

with at least one strict inequality for some j. If x is a nondominated solution, the vector f (x) = (/i(x), . . . , fk{x)) G M'^ 
is called efficient. 

We say that a feasible solution, y, is dominated by a feasible solution, x, if fi{x) < fi{y) for all i — 1, . . . , fc and 



i{x) ^ f (y)- We denote by Xe the set of all nondominated solutions for MOPBPf g ^ and by Ye the image under the 
objective functions of Xe, that is. Ye — {f{x) : x G Xe}- Note that Xe is a subset of M" {decision space) and Ye is 
a subset of M*^ {space of objectives). 

From the objective functions f = (/i, . . . , fk), we obtain a partial order on Z" as follows: 

X y ■.<F=^ {{x) % f(j/) or a; = y. 

Note that since f : R" M'^, the above relation is not complete. Hence, there may exist incomparable vectors. 

In the following sections we describe some algorithms for solving MOPIP using tools from algebraic geometry. In 
particular, in each of these methods, we transform our problem in a certain system of polynomial equations, and we 
use Grobner bases to solve it. 



3. Obtaining nondominated solutions solving systems of polynomial equations 

In this section we present the first approach for solving multiobjective polynomial integer programs using Grobner 
bases. For this method, we transform the program in a system of polynomial equations that encodes the set of feasible 
solutions and its objective values. Solving that system in the objective values, and then, selecting the minimal ones in 
the partial componentwise order, allows us to obtain the associate feasible vectors, thus, the nondominated solutions. 

Through this section we solve MOPBPf h. Without loss of generality, we reduce the general problem to the problem 
without inequality constraints since we can transform inequality constraints to equality constrains as follows: 

(1) g{x) <0 g{x)+ ^0,z eR. 

where the quadratic term, z^, assures the nonnegativity of the slack variable and then, less than or equal to type 
inequality. Initially, we suppose that all the variables are binary. In Remark 13.11 we describe how to modify the 
algorithm to incorporate the above slack variables. 
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part of the constraints. For this transformation, we add k new variables, yi,...,yk to the problem, encoding the 
objective values for all feasible solutions. The modified problem is: 

min {yi,...,yk) 

s.t. hr{x) =0 r=l,...,s 

Xi(xi — 1) =0 2 = 1, . . . , n 

y e M*-^ X £ R" 

where integrality constraints are codified as quadratic constraints so, MOPBPf h is a polynomial continuous problem. 

The algorithm consists of, first, obtaining the set of feasible solutions of Problem ^ in the y variables; then, 
selecting from that set those solutions that are minimal with respect to the componentwise order, obtaining the set 
of efficient solutions of MOPBPf h. The feasible solutions in the a;- variables associated to those efficient solutions 
correspond with the nondominated solutions of MOPBP{ h. 

Then, first, we concentrate in describing a procedure for solving the system of polynomial equations that encodes 
the feasible region of Problem i.e. the solutions of 

hr{x) for all r = 1, . . . , s 

(3) Vj-hi^) -0 foraUj-l,...,A: 

Xi{xi — 1) =0 for alH = 1, . . . , n. 

For analyzing the system ^ we use Grobner bases as a tool for solving systems of polynomial equations. Further 
details can be found in the book by Sturmfels pT] . 

The set of solutions of ([3]) coincides with the affine variety of the following polynomial ideal in M[?;i, . . . , ?/fc, a;i, . . . , Xn]'- 

I = {hi[x), . . . ,h^{x),yi - fi{x), ...,yk~ fk{x), xi{xi - 1), . . . ,x„(x„ - 1)). 

Note that / is a zero dimensional ideal since the number of solutions of the equations that define / is finite. Let V{I) 
denote the afhne variety of /. If we restrict / to the family of variables x (resp. y) the variety V{I n M.[xi, . . . ,Xn]) 
(resp. V{I n . . . , yk])) encodes the set of feasible solutions (resp. the set of possible objective values) for that 
problem. 

Applying the elimination property, the reduced Grobner basis for /, Q, with respect to the lexicographical ordering 
with yk -< ■ ■ ■ -< 2/1 ^ Xn -< ■ ■ ■ ^ xi gives us a method for solving system Q sequantially, i.e., solving in one 
indeterminate at a time. Explicitly, the shape of Q is: 

1) Q contains one polynomial in M[?//c]: Pk{yk) 

2) g contains one or several polynomials in M.[yk^i,yk] ■ p\_^{yk-i,yk), ■ ■ ■ ,^^^1' (j/fc-i, j/t). 

k + \) Q contains one or several polynomials in K[a;„, j/i, . . . , yk] ■ Qni^n, y), ■ • ■ , Qn" (^^n, y)- 

k + n) Q contains one or several polynomials in M[a;„, yi, . . . , yk] ■ ^K^^i: • ■ ■ : ^my), ■ ■ ■ ,<ln {^i^ • ■ ■ j y)- 
Then, with this structure of Q, we can solve, in a first step, the system in the y variables using those polynomial in 
Q that only involve this family of variables as follows: we first solve for yk in Pk{yk) = 0, obtaining the solutions: 
y\, yf., . . .. Then, for fixed j/^, we find the common roots of Pk_i,Pk-i, ■ ■ ■ getting solutions yk_i j., yl-i rJ • ■ • 
on, until we have obtained the roots for pi{yi, . . . ,yk). Note that at each step we only solve one- variable polynomial 
equations. 

We denote by H. the above set of solutions in vector form 

^ = {(yi, ■■■,yk) -Pkiiik) = o,pl_i{yk-i,yk) = o, . . . ,p'k-i'{yk-i,yk) = o, . .. 

Pl{yi,y2, . . . ,yfc) = 0, . . . ,p"Hyi,2/2, ...,yk)= 0}. 

As we stated above, il is the set of all possible values of the objective functions at the feasible solutions of MOPBPf h. 
We are looking for the nondominated solutions that are associated with the efficient solutions. From 17, we can select 
the efficient solutions as those that are minimal with respect to the componentwise order in M'^'. So, we can extract 
from n the set of efficient solutions, Yg: 

Ye = m, ■■■,yl)en -.^yl ...,y'k)en with y'^ < y* for j = 1, . . . , /c and (yi, . . . ,yl.) ^ [yl, . . .,yl)} 

Once we have obtained the solutions in the y variables that are efficient solutions for MOPBPf h, we compute with an 
analogous procedure the nondominated solutions associated to the y- values in Ye- It consists of solving the triangular 
system given by G for the polynomial where the x-variables appear once the values for the y- variables are fixed to be 
each of the vectors in Ye- 

A pseudocode for this procedure is described in Algorithm [TJ 

Theorem 3.1. Algorithm[^ either provides all nondominated and efficient solutions or provides a certificate of infea- 
sibility whenever G = {1}. 



(2) 



Aigoriinm i: ooiving mKjfir oy soivmg systems or polynomial equations 



Input : fi,...Jk, hi,...hs eR[ 

Initialization: / = (/i - iji, . . . , A- - j/fc, ft-i, . • . , hs,xi{xi - 1), . . . ,x„(a;„ - 1)). 
Algorithm: 

Step 1.: Compute a Grobner basis, G, for / with respect to a lexicographic order with 

J/fc -<••• ^ 2/1 ^ a^n -<•••-< a;i . 
Step 2.: Let = G H M.[yi+i, ■ ■ ■ ,yk] be a Grobner basis for If ^ I Ci R[yi+i, . . . ,yk], for Z = 0, . . . , /c — 1. (By 

the Elimination Property). 

(1) Find all ykEViGl^,). 

(2) Extend every ijk to {yk-i,yk) & V{Gl-2)- 

{k - 1) Extend every (yg, . . .,yk) to (2/2,2/3,- ■ • ,yfe) e V{G\). 

(k) Find all yi such that (yi, . . . ,yk) G T^(Gq). 
Step 3.: Select from V{Gq) the minimal vectors with respect to the usual componentwise order in M'^. Set Ye 
this subset. 

Step 4.: Let G; = G n R[j/i, . . . , yk,xi+i, . . . , a;„] a Grobner basis for /; n R[j/i, . . . , yk,xi+i, . . . ,x„], for 
/ = 0, . . . , 71 — 1. (By the Elimination Property). Denote by 

Si = {(2/1, . . . ,2/fc,ii+i, • ■ • ,in) : (2/1, ■ • ■ , J/fc) e Ye, and 3(xi, ... ,0;;) such that (xi, . . . ,x„) is feasible } for 
/ = 0,...,n-l. 

(1) Find aU x„ such that (2/1, . . . ,yfc,in) e V^(G„_i) n Sn-i- 

(2) Extend every x„ to ((yi, . . . , ?/fc, x„_i, £„) £ V'(G„_2) n 5„_2. 

(n - 1) Extend every (yi, ...,7/^,^3,.. . ,£„) to (j/i, . . .,yk,X2,X3, . . . ,a;„) £ V^(Gi) n Si. 
(n) Find all ii such that (2/1, . . . ,yk,xi, . . . ,i;„) € V{Ga) D So- 
Set Xe = T^xiViGo) n 5*0), where tt^ denotes the projection over the a;-variables. 
Output: Ye the set of efficient solutions and Xe the set of nondominated solutions for MOPEPf ^. 



Proof. Suppose that G 7^ {1}. Then, G^ -^ has exactly one element, namely p{yk)- This follows from the observation 
that / n M[yfe] is a polynomial ideal in one variable, and therefore, needs only one generator. 

Solving piyk) = we obtain every ijk G V{G^_^). Sequentially we obtain yk-i extending ijk to the partial solutions 
iVk-ijilk) in V{G\_^) and so on. 

By the Extension Theorem, this is always possible in our case. 

Continuing in this way and applying the Extension Theorem, we can obtain all solutions (j/i, . . . ,yk) in V{G Ci 
M[2/i, . . . ,2/fc]. These vectors are all the possible objective values for all feasible solutions of the problem. Selecting 
from V{G D R[yi, ■ ■ ■ , yk]) those solutions that are not dominated in the componentwise order in M'^', we obtain Ye- 

Following a similar scheme in the x- variables, we have the set V{Go) f) Sq encoding all efficient (in the first k 
coordinates) and nondominated (in the last n coordinates) solutions. 

Finally, if G = {1}, then, the ideal / coincides with R[j/i, . . . , y^, xi, . . . , indicating that V{I) is empty (it 
is the set of the common roots of all polynomials in K[yi, . . . ,yk,xi, . . . ,a;„]). Then, we have an infeasible integer 
problem. □ 

Remark 3.1. In the case when we have added slack variables, as explained in ([1]), we slightly modify the above 
algorithm solving first in the slack variables and selecting those solutions that are real numbers. Then continue with 
the procedure described in Algorithm]^ 

Remark 3.2. The Grobner basis, Q, computed for solving the system of polynomial equations can be computed with 
respect to any other elimination ordering. The only conditions that are required for that ordering is that it allows to 
separate the family of x— variables from the family of y -variables and such that the system of polynomials given by that 
basis allows solving first for the y-variables and then for the x-variables sequentially. 

4. Obtaining nondominated solutions by the Chebyshev norm approach 

In this section we describe two more methods for solving MOPIP based on a different rationale, namely scalarizing 
the multiobjective problem and solving it as a parametric single-objective problem. We propose a methodology based 
on the application of optimality conditions to a family of single-objective problems related to our original multiobjective 
problem. The methods consist of two main steps: a first step where the multiobjective problem is scalarized to a family 
of single-objective problems such that each nondominated solution is an optimal solution for at least one of the single- 
objective problems in that family; and a second step that consists of applying necessary optimality conditions to 
each one of the problems in the family, to obtain their optimal solutions. Those solutions are only candidates to be 
nondominated solutions of the multiobjective problem since we just use necessary conditions. 

For the first step, the scalarization, we use a weighted Chebyshev norm approach. Other weighted sum approaches 
could be used to transform the multiobjective problem in a family of single-objective problems whose set of solutions 
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adequate since it does not require to impose extra hypothesis to the problem. This approach can be improved for 
problems satisfying convexity conditions, where alternative well-known results can be applied (see |15| for further 
details). 

For the second step, we use the Fritz- John and Karush-Kuhn- Tucker necessary optimality conditions, giving us two 
different approaches. In this section we describe both methodologies since each of them has its own advantages over 
the other. 

For applying the Chebyshev norm scalarization, we use the following result that states how to transform our problem 
to a family of single-objective problems, and how to obtain nondominated solutions from the optimal solution of those 
single-objective problems. Further details and proofs of this result can be found in [15 . 



Theorem 4.1 (Corollary 11.21 in ^ISj). Let MOPBPf g h be feasible, x* is a nondominated solution of MOPBPf g h 
if and only if there are positive real numbers , . . . , Wfe > such that x* is an image unique solution of the following 
weighted Chebyshev approximation problem: 
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i — 


1,.. 


.,fc 
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j = 


1,- 


. , m 


hr{x) 


= 


r — 


1,- 


. ,s 




= 


i — 


1,.. 


. ,n 


7 e M 


X e 1 









where y — (yi , . 
j = 1, . . . , /c. 



■ ,2/fc) e 



is a lower bound of f ^ (/i, //,.), i.e., yt < fi{x) for all feasible solution x and 



is the unique solution of jPu^l for 



According to the above result, every nondominated solution of MOPBPf g ^ 
some u; > 0. We apply, in the second step, necessary optimality conditions for obtaining the optimal solutions for 
those problems (taking lo as parameters) . These solutions are candidates to be nondominated solutions of our original 
problem. Actually, every nondominated solution is among those candidates. 

In the following subsections we describe the above-mentioned two methodologies for obtaining the optimal solutions 
for the scalarized problems (|P^[) for each cu. 



4.1. The Chebyshev-Karush-Kuhn- Tucker approach: The first optimality conditions that we apply are the 
Karush-Kuhn- Tucker (KKT) necessary optimality conditions, that were stated, for the general case, as follows (see 
e.g. [I] for further details): 

Theorem 4.2 (KKT necessary conditions). Consider the problem: 

min f{x) 

s.t. gj{x) <0 =l,...,m 
hr{x) =0 r = l,...,s 

X e M" 

Let X* be a feasible solution, and let J — {j '■ gj{x*) — 0}. Suppose that f and gj, for j — 1, . . . ,m, are differ entiable 
at X* , that gj , for j ^ J , is continuous at x* , and that hr, for r — \, s, is continuously difjerentiable at x* . Further 
suppose that S/gj, for j 6 /, and Vhr, for r ~ 1, . . . , s, are linearly independent (regularity conditions). If x* solves 
Problem\^ locally, then there exist scalars Xj, for j — 1, . . . ,m, and iir, for r — 1, . . . , s, such that 

m s 

Vf{x*)+^\jVgj{x*)+ ^fir'^hrix*) =0 

(KKT) 3 = 1 r=l 

^j9]{x*) =0 for j = 1, . . . ,m 

Xj > for j ^l,...,m 

From the above theorem the candidates to be optimal solutions for Problem ^ are those that either satisfy the 
KKT conditions (in the case where all the functions involved in Problem ^ are polynomials, this is a system of 
polynomial equations) or do not satisfy the regularity conditions. Note that these two sets are, in general, not disjoint. 

Regularity conditions can also be formulated as a system of polynomial equations when the involved functions are 
all polynomials. Let x* be a feasible solution for Problem ([4]), x* does not verify the regularity conditions if there 
exist scalars Xj, for j G J, and /i^, for r = 1, . . . , s, not all equal to zero, such that: 

(Non-Regularity) ^ ^j^9j + ^ Hr'^K — 

The above discussion justifies the following result. 



Corollary 4.1. Let x* be a nondominated solution for 
polynomial equations ^ or for some lu > 0. 



MOPBPf^g^h 



Then, x* is a solution of the systems of 



(5) 



k m s n 

^ V,UJ, Vfi{x) + Xj'^gjix) + HjVhr{x) + ^ A 5^l{2Xi - 1) = 
i=l j=l r=l 1=1 

Vi ijJi {fi{x) - yi) - 7 = 0, i = 1, . 



for some Xj gj{x) — 0, for j — 1, . . . ,m, Xj > 0, for j — 1, . . . ,m, and Vi > 0, for i = 1, . 

k 



(6) 



i=l j=l r=l 1=1 

- - 7 < 0, i = 1, . 



with X G M" such that gj{x) < 0, for j = 1, . . . , m, hr{x) — 0, for r — 1, . . . , s 
Xj > 0, for j — 1, . . . ,m, and Vi > 0. for i ~ 1, . . . , k. 

Let X^^^ denote the set of solutions, in the x-variables, of system ^ and let X^^ denote the set of solutions, in 
the x-variables, of system ([6]) (the problem is solved avoiding inequality constraints, then every solution is evaluated 
to check if it satisfies the inequality constraints). 

For solving these systems (Chebyshev-KKT and Non-Regulariry) , we use a Grobner bases approach. Let / be the 
ideal generated by the involved equations. 

Let us consider a lexicographical order over the monomials in R[x, 7, A, /x, (3] such that x-<7^A^z^^/i^/3. 
Then, the Grobner basis, G, for / with this order has the following triangular shape: 

• G contains one polynomial in K[x„]: 

• G contains one or several polynomials in R[a;„_i,x„] : p^_]^(a;„_i, a:„), . . . ,p™_!:]^(a:„_i, 2:„). 



• G contains one or several polynomials in R[x] : pl{xi, . . . , a;„), . . . . . . , a;„). 

• The remaining polynomials involve variables x and at least one 7, A, fi, v or /3. 

We are interested in finding only the values for the a;-variables, so, we avoid the polynomials in G that involve any 
of the other auxiliary variables. In general, we are not able to discuss about the values of the parameters 7, A, ^, v and 
/3. Needless to say that in those cases when we can do it, some values of x may be discarded simplifying the process. 
We denote by G^ the subset of G that contains only polynomials in the x-variables. By the Extension Theorem, G^ is 
a Grobner basis for / n R[a;i, . . . , 

Solving the system given by G'^ and checking feasibility of those solutions, we obtain as solutions those of our KKT 
or Non-Regularity original systems. 

It is clear that the set of nondominated solutions of our problem is a subset of X^^'^ IJX^^ , since either a solution 
is regular, and then, KKT conditions are applicable or it satisfies the non regularity conditions. However, the set 
X^^^ U X^^ may contain dominated solutions, so, at the end we must remove the dominated ones to get only Xe- 



The steps to solve Problem MOPBPf g ^ using the Chebyshev-KKT approach are summarized in Algorithm [5] 



Algorithm 2: Summary of the procedure for solving MOPBP using Chebyshev-KKT approach. 



Input : /i, 
Algorithm: 



, /fc, 91, . . .5m, ft-l, • ■ ■ e R[xi, . 



Step 1: Formulate the Chebyshev scalarization of MOPBPf g h (Problem ( |P^D ) 

Step 2: Solve System (O in the a;- variables: X^^. 

Step 3: Solve System ([HJ in the x-variables: X^^. 

Step 4: Remove from X^^^ U X^^ the subset of dominated solutions: Xe- 



Output: Xe the set of nondominated solutions for MOPBPf g ^ 



Theorem 4.3. Algorithmic solves Problem MOPBPf ^ h in a finite number of steps 



4.2. The Chebyshev-Pritz-John approach. Analogously to the previous approach, once we have scalarized the 
original multiobjectivc problem to a family of single-objective problems, in this section we apply the Fritz- John (FJ) 
conditions to all the problems in this family. The following well-known result justifies the use of FJ conditions to 
obtain candidates to optimal solutions for single-objective problems. Proofs and further details can be found in [I]. 



mill f{x) 



(7) 



s.t. gj{x) < = 1, . . . , m 
hr{x) — Q r — \, . . . , s 



Let X* he a feasible solution, and let J — {j '■ gj{x*) — 0}. Suppose that f and gj , for j = I, . . . ,m, are differentiate 
at X* , and that hr, for r = 1, . . . , s, is continuously differentiable at x* . If x* locally solves Problem ([7]), then there 
exist scalars Xj , for j = 1, . . . ,m, and fir, for r = 1, . . . , s, such that 



(FJ) 



Xj > 
(Ao,A,Ai) ^(0,0,0) 



= 

for j ^l,...,m 
for j = l,...,m 



Note that, in the FJ conditions, regularity conditions are not required to set the result. 



Corollary 4.2. Let x* be a nondominated solution for MOPBPfgh Then, x* is a solution of the system of polynomial 
equations ([S]) for some Vi, Xj, fir, Pi, for i — I, . . . , k,l = 1, . . . ,n, j = 1, . . . ,m, r = I, . . . , s and w > 0. 

k 

Xq -^i^i = 



(8) 



V^LO^ Vf,{x) + ^ XjVg^ix) + ^ fijVhr{x) + ^1 ^^iC^"^^ - 1) = 



1=1 



Vi [uji ifi{x) - j/i) - 7) = 0,i = 1, . . . , /c 

Xj gj{x) ^0, j ^0,. . .,m, , 

where Xj > 0, for j — I, . . . ,m, Vi > 0, for i = 1, . . . ,k and Su, for l,i — 1, . . . ,n, denotes the Kronecker delta 



function, Si, 



1 tfl^i 
otherwise 



Let Xp'^ denote the set of solutions, in the x- variables, that are feasible solutions oilMOPBPf g hi and solutions of 



system 1^. 

The set of nondominated solutions of our problem is a subset of X^'\ since every nondominated solution is an 
optimal solution for some problem in the form of ([8|), and every solution of this single-objective problem is a solution 
of the FJ system. 

However, dominated solutions may appear in the set of solutions of ((S]), so, a final elimination process is to be 
performed to select only the nondominated solutions. 



The steps to solve MOPEPf ^ ^ using the Chebyshev-FJ approach are summarized in Algorithm |31 



Algorithm 3: Summary of the procedure for solving MOPBP using the Chebyshev-FJ approach. 

Input : /i, . . . ,/fe, gi, . . . gm,hi, . . . ,hr € M.[xi, . . . ,x„] 
Algorithm: 

Step 1: Formulate the Chebyshev scalarization of MOPBPf g h (Problem ( |P^D ) 
Step 2: Solve system (jSJ in the x-variables for any value oi uj > 0: X^"^ . 
Step 3: Remove from X^'^ the set of dominated solutions: Xe- 



Output: Xe the set of nondominated solutions for Problem {MOPBPf g h 



Theorem 4.5. Algorithm\^ solves MOPBPf g ^ in a finite number of steps 



The last part of the section is devoted to show how to solve the Chebyshev-FJ system using Grobner bases. 
Consider the following polynomial ideal 

k k m s n 

I = (Ao-^i^i,^i^,cJi V/i(a;) + ^ AjVgj(x) + ^/^jV/ir.(a;) + ^ A Su{2xi-l),ui {uji -yi) -7), ■■■,Vk{u)k (Jk{x)~ 

i— 1 i— 1 J — 1 r=X l=\ 

Vk) - 7), Ai gi{x), .. .,Xm gm{x)) 

in the polynomial ring R[x, 7, A, /i, (3] . 

Let us consider a lexicographical order over the monomials in IR[x, 7, A, v, fi, (3] such that x-<7-(A-(i^^/i-(/3. 
Then, the Grobner basis, Q, for / with this order has the following triangular shape: 

• Q contains one polynomial in R[x„]: Pn{xn) 

• Q contains one or several polynomials in M[a:;„_i, 2:„] : p,\_]^(a:;„_i, . . . ,p™i:]^(a;„_i, x„) 



• Q contains one or several polynomials in M[x] : p\{xi, . . . , a;„), . . . ,p™"(a;i, . . . , Xn) 



We are interested in finding only the values for the a;-variables, so, we avoid the polynomials in Q that involve 
any of the other auxiliary variables. We denote by the subset of Q that contains only all the polynomials in the 
X- variables. By the Extension Theorem, Q"^ is a Grobner basis for / n R[a::i, . . . , 

Solving the system given by t/^, we obtain as solutions, those of our FJ original system. 

Remark 4.1 (Convex Case). In the special case where both objective functions and constraints are convex, sufficient 
KKT conditions can be applied. If the feasible solution x* satisfies KKT conditions, and all objective and constraints 
functions are convex, then x* is a nondominated solution. As a particular case, this situation is applicable to linear 
problems. 

In this case, we may choose a linear scalarization instead of the Chebyshev scalarization. With this alternative 
approach, the scalarized problem is 



min y^ts fsjx) 



s=l 

s.t. g-j{x) <0 j m 

hr{x) =0 r = 1, . . . , s 
Xi{xi — \) ~0 i — l,...,n 

for ti,... ,tk > 0. 

Then, by Corollary 11.19 in |15j . and denoting by S the feasible region, if f{S) + R^J_ is convex, then each x* is a 
nondominated solution if and only if x* is a solution of Problem \4. l\ for some ti, . . . ,tk > 0. 

Using both results, necessary and sufficient conditions are given for that problem and the removing step is avoided. 

Remark 4.2 (Single-Objective Case). The same approach can be applied to solve single- objective problems. In this 
case, KKT (or FJ) conditions can be applied directly to the original problem, without scalarizations. 

5. Obtaining nondominated solutions by multiobjective optimality conditions 



In this section, we address the solution of MOPBPf g h by directly applying necessary conditions for multiobjective 



problems. With these conditions we do not need to scalarize the problem, as in the above section, avoiding some steps 
in the process followed in the previous sections. 

The following result states the Fritz- John necessary optimality conditions for multiobjective problems. 

Theorem 5.1 (Multiobjective FJ necessary conditions. Theorem 3.1.1. in ^19]). Consider the problem: 

min {fi{x),...,fk{x)) 
s.t. gj{x) <0 =l,...,m 

^> hr{x) =0 r = l,...,s 

X e R" 

Let X* a feasible solution. Suppose that fi, for i — 1, . . . ,k, gj, for j — 1, . . . , m and h^, for r — 1, . . . , s, are 
continuously differentiable at x* . If x* is a nondominated solution for Problem\^ then there exist scalars Vi, for 
i — 1, . . . ,k, Xj, for j — 1, . . . ,m, and fj,r, for r — I, . . . , s, such that 

k ni s 

^z^,V/,(a;*)-}-^Aj V5j(x*) -f ^HrVhr{x*) =0 

i—1 j—1 r—1 

(MO-FJ) >^j9jix*) ^ /orj = l,...,TO 

Xj > for j — 1, . . . ,m 

Vi > for i — 1, . . . ,k 

(z.,A,m) 7^(0,0,0) 

With this result, one can solve the system given by the necessary conditions to obtain candidates to be nondominated 
solutions for our problem. For solving this system, we use lexicographical Grobner bases as in the above sections. We 
summarize the algorithm for solving the multiobjective polynomial problem in Algorithm [H 

Algorithm 4: Summary of the procedure for solving MOPBP using the multiobjective FJ optimality conditions. 
Input : /i, . . . ,/fc, gi, /ii, /i^ € R[xi, . . . ,x„] 

Algorithm: 

Step 1: Solve system (|MO-Fjp : Xg^^'^. 

Step 2: Remove from X^'^^'' the subset of dominated solutions: Xe. 



Output: Xe the set of nondominated solutions for Problem MOPBPf g h 



Remark 5.1. In the special case where both objective functions and constraints are convex, Theorem \5.1\ gives sufficient 



nondominance conditions for MOPBPf g h requiring that Vi > (see Theorem 3.1.8 in |19| ). 



A series of computational experiments have been performed in order to evaluate the behavior of the proposed 
solution methods. Programs have been coded in MAPLE 11 and executed in a PC with an Intel Core 2 Quad 
processor at 2x 2.50 Ghz and 4 GB of RAM. The implementation has been done in that symbolic programming 
language, available upon request, in order to make the access easy to both optimizers and algebraic geometers. 

We run the algorithms for three families of binary biobjective and triobjective knapsack problems: linear, quadratic 
and cubic, and for a biobjective portfolio selection model. For each problem, we obtain the set of nondominated 
solutions as well as the CPU times for computing the corresponding Grobner bases associated to the problems, and 
the total CPU times for obtaining the set of solutions. 

We give a short description of the problems where we test the algorithms. In all cases, we use binary variables 
Xj, j = 1, . . . ,n, where Xj = 1 means that the item (resp. security) j is selected for the knapsack (resp. portfolio) 
problem. 

(1) Biobjective (linear) knapsack problem (biobj_linkn): Assume that n items are given. Item j has associated 
costs Qj, for two different targets, and a unit profit aj, j = 1, . . . ,n. The biobjective knapsack problem calls 
for selecting the item subsets whose overall profit ensures a knapsack with value at least b, so as to minimize 
(in the nondominance sense) the overall costs. The problem may be formulated: 



n 

s.t. '^aiXi>b, xe{0,l}" 



i=l 



(2) Biobjective cubic knapsack problem (biobj_cubkn): Assume that n items are given where item j has an integer 
profit ttj. In addition we are given two nxnxn matrices = {p\ji^) and = (p^ji^), where p^^^. and p'^j,. are 
the costs for each of the targets if the combination of items i,j, k is selected for i < j < k; and two additional 
n X n matrices = {qlj) and = {q}j), where gj^- and gf^- are the costs for the two different targets if both 
items i and j are selected for i < j The biobjective cubic knapsack problem calls for selecting the item subsets 
whose overall profit exceeds the purpose of the knapsack 6, so as to minimize the overall costs. The problem 
may be formulated: 

n n n—2 n—1 n n n n—2 n—1 n 

+ ^ Yl Yl Pijl ' YjYj 4 ^i^O + ^Y^ Z] ^0 Xl) 

i=l j=i i—1 l=j-\-l i=\ j=i i—1 j—i-\-l l=zj-\-l 

n 

s.t. ^ Oi Xj > 6, X e {0, 1}" 



(3) Biobjective quadratic knapsack problem (biobj_qkn): This problem may be seen as a special case of the 
biobjective cubic knapsack problem when there are no cost correlations between triplets. 

(4) Triobjective (linear) knapsack problem (triobj_linkn): Assume that n items are given where item j has an 
integer profit aj. In addition, we are given three vectors q^ = {qj), q^ = (qj) and q^ = (qj), where qj,qj and 
qj are the costs for three different targets if j is selected. The triobjective knapsack problem calls for selecting 
the item subsets whose overall profit ensures a profit for the knapsack at least b, so as to minimize (in the 
nondominance sense) the overall costs. The problem is: 

n n n 

(Y2 ^1 ' Yl *l ' Yl ) 

3 = 1 3 = 1 j=l 



S.t. ^ aiXi >b, X € {0, 1}^ 



(5) Triobjective cubic knapsack problem (triobj_cubkn): We are given n items where item j has an integer profit 
aj. In addition, we are given three n x n x n matrices = (Pi,fc),P^ = (Puk) and P^ = (pf,^,), wheve pj-^.,pf 



±11 auuiuiuii, wc die given tiiicc /niia,uin.cD J —yPijkJ^-" — \l'ijk > '^^'^^ — Wjk J ^ Pijk^ fijk 

and pfjf. are the costs for each of the targets if the combination of items i,j and k is selected for / < j < k; 
and three additional nxn matrices = {qlj),Q^ = (g^j) and = (qfj), where q]j,q^j and q^ are the costs 
for three different targets if both items i and j are selected for i < j The triobjective cubic knapsack problem 
calls for selecting the item subsets whose overall profit ensures a value of 6, so as to minimize the overall costs. 



71 71 n — 2 71— In Ti n n — 2 n— 1 n 

n n 71 — 2 71 — 1 71 

i—1 j—i i—1 



(6) Triobjective quadratic knapsack problem (triobj_qkn): This problem may be seen as a special case of the 
triobjective cubic knapsack problem when there are no cost correlations between triplets. 

(7) Biobjective portfolio selection (portfolio): Consider a market with n secm'ities. An investor with initial 
wealth b seeks to improve his wealth status by investing it into these n risky securities. Let Xi be the 
random return per a lot of the i-th secutiry (i = l,...,n). The mean, = and the covariance, 
Cij — Cov(Xi, Xj),i, j — of the returns are assumed to be known. Let Xi be a decision variable 
that takes value 1 if the decision-maker invests in the i-th security and otherwise. Denote the decision 
vector hy X = {xi, . . . , a;„). Then, the random return for a inversion vector x from the securities is X!i=i ^i-^i 



and the mean and variance of this random variable are i^Ei^i XiXi] — 2_^lJ-i^i yo.i^i'^i^i XiXi) — 

1=1 

n n 
i=l j=l 

Let a.i be the current price of the i-th security. Then, if an investor looks for minimizing his investment risk 
and simultaneously maximizing the expected return with that investment, the problem can be formulated as: 

n n >. n n 

mm {Var(^XiXi),-E\^XiXi\) min Xj, - ^ /i^ Xi) 

i—1 i—1 \ i—1 i—1 



s.t.y^ QiXi <b, xe{0,iy' 



i=l 



s-t."^ OiXi < b, xe{0, 1}" 
i=i 



For each of the above 7 classes of problems, we consider instances randomly generated as follows: a.i is randomly 
drawn in [—10, 10] and the coefficients of the objective functions, p'^ji, aij and /i^, range in [—10, 10]. Once the 
constraint vector, (ai, . . . , a„), is generated, the right hand side, 6, is randomly generated in [1, | X]"=i For each 
type of instances and each value of n in [2, 13] we generated 5 instances. 

Tables [T] and [3] contain a summary of the average results over the different instances generated for the above 
problems. Each algorithm is labeled conveniently: algl corresponds with Algorithm [U kkt is Algorithm [21 kkt_sl 
is Algorithm [2] where the inequality is transformed to an equation using a slack variable, f j is Algorithm[31 f j_sl is 
Algorithm [3] where the inequality is transformed to an equation using a slack variable and mof j stands for Algorithm 
m For each of these algorithms we present the CPU time for computing the corresponding Grobner basis (tgb), the 
total CPU time for obtaining the set of nondominated solutions (ttot), the number of nondominated solutions (#nd) 
and the number of variables involved in the resolution of the problem (#vars). 

From those tables, the reader may note that Algorithm[T]is faster than the others for the smallest instances, although 
the CPU times for this algorithm increase faster than for the others and it is not able to obtain solutions when the 
size of the problem is around 12 variables. The algorithms based on Chebyshev scalarization (kkt, kkt_sl, f j and 
f j_sl) are better than algl for the largest instances. The differences between these four methods are meaningful, 
but the algorithms based on the KKT conditions are, in almost all the instances, faster than those based on the FJ 
conditions. Note that considering slack variables to avoid the inequality constraint is not better, since the CPU times 
when the slack variable is considered are larger. Finally, the best algorithm, in CPU time, is mof j since except for the 
small instances is the fastest and it was able to solve larger instances. 

One may think that the last step of our methods, i.e. removing dominated solutions, should be more time consuming 
in algl than in the remaining methods since algl does not use optimality conditions. However, from our experiments 
this conclusion is not clearly supported. Actually, although this process, in time consuming, when the dimension of 
the problem increases this time is rather small compared with the effort necessary to obtain the Grobner bases. 

Table [5] shows some information about each of the presented algorithms. For a multiobjective problem with n 
variables, m polynomial inequality constraints given by g = (gi, . . . ,grn), s polynomial equality constraints given by 
h = (/ii, . . . , hs) and k objectives functions given by f = (/i, . . . , fk), Table 3 shows the number of variables (#var), 
the number of generators (#gen) and the maximal degrees (maxdeg) of the initial polynomial ideals related to the each 
of the algorithms. These numbers inform us about the theoretical complexity of the algorithms. The computation 
of Grobner bases depends of the number of variables (in general, double exponential) and of the size of the initial 
system of generators (degrees and number of polynomials). Actually, it is known that computing a Grobner basis using 
Buchberger Algorithm is doubly exponential in the number of variables. Some complexity bounds for this algorithm 
involving #var, #gen and maxdeg can be found in [12] . 



but the number of initial generators for algl is, in general, smaller than the same number for mojf , since the number 

of objectives is usually smaller than the number of variables. Furthermore, maximal degrees are smaller in algl 
than in mojf . However, in practice, mojf is faster than algl since using optimality conditions helps in identifying 
nondominated solutions. 
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